Many‐field packet classification with decomposition and reinforcement learning

نویسندگان

چکیده

Scalable packet classification is a key requirement to support scalable network applications like firewalls, intrusion detection, and differentiated services. With ever increasing in the line-rate core networks, it becomes great challenge design solution using hand-tuned heuristics approaches. In this paper, we present learning-based engine by building an efficient data structure for different ruleset with many fields. Our method consists of decomposition fields into subsets separate decision trees on those deep reinforcement learning procedure. To decompose given ruleset, consider grouping metrics standard deviation individual introduce novel metric called diversity index (DI). We examine schemes construct each scheme compare results. The results show that SD 11.5% faster than DI metrics, 25% random 2 40% 1. Furthermore, our selection can be applied varying rulesets due its independence.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Forgetting Classification and Measurement for Decomposition-based Reinforcement Learning

Forgetting is a memory phenomenon that affects knowledge used to perform behaviors and tasks. In this work, two metrics are presented to aid the diagnosis of forgetting in decomposition-based reinforcement learning systems. With these metrics, developers now have the ability to classify types of forgetting, identify when important knowledge is lost, located wasted computation effort, and verifi...

متن کامل

Task Decomposition in Reinforcement Learning

Decomposing a complex task into a set of simpler subtasks is a common technique used by problem solving agents. In reinforcement learning decomposition can be used by having separate modules learn to achieve individual subgoals independently and in parallel. Since each module can ignore parts of the state space that are not relevant to its task, learning time is drastically reduced. However, si...

متن کامل

Q-Decomposition for Reinforcement Learning Agents

The paper explores a very simple agent design method called Q-decomposition, wherein a complex agent is built from simpler subagents. Each subagent has its own reward function and runs its own reinforcement learning process. It supplies to a central arbitrator the Q-values (according to its own reward function) for each possible action. The arbitrator selects an action maximizing the sum of Q-v...

متن کامل

Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition

This paper presents a new approach to hierarchical reinforcement learning based on decomposing the target Markov decision process (MDP) into a hierarchy of smaller MDPs and decomposing the value function of the target MDP into an additive combination of the value functions of the smaller MDPs. The decomposition, known as the MAXQ decomposition, has both a procedural semantics—as a subroutine hi...

متن کامل

Title of Thesis: Improving Packet Classification: Learning from Traffic Improving Packet Classification: Learning from Traffic

Some rules in a packet classifier’s ruleset are more likely to be matched than others. Which of these rules are most likely to be matched cannot be known a priori, however. As a result, a classifier should be able to adapt itself to the traffic that it sees. This thesis explores the idea of using the traffic a packet classifier is seeing to tune that classifier’s search structure in order to im...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IET networks

سال: 2022

ISSN: ['2047-4954', '2047-4962']

DOI: https://doi.org/10.1049/ntw2.12038